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Problem  and  Objective 


•  Problem 

—  Key  Systems  Engineering  documents  require  significant  effort  to  keep 
current,  and  to  keep  the  content  synchronized  in  an  environment 
where  change  is  constant.  This  often  results  in  the  documents 
becoming  obsolete  relative  to  fast  moving  development  activities  and 
inconsistencies. 

•  Objective 

—  Research  a  mechanism  and  ability  to  align  SE  documents  (SEP,  TEMP, 
ISP)  such  that  the  program  documents  track  and  compliment  one 
another,  are  easier  to  produce  and  update,  support  agile 
environments,  and  to  move  towards  a  data  centric  rather  than 
document  centric  focus 
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Research  Approach 


Flexible  Modular  Documentation  for  SE 

1.  Three  key  SE  documents  were  identified  to  research  (SEP,  TEMP  and  ISP) 

2.  Develop  a  modular  architecture  for  each  document 

3.  Determine: 

a)  A  dependency  structure 

b)  Relationships 

c)  Interdependencies 

4.  Create  linkages  between  the  various  topic  areas  of  the  multiple  SE  artifacts  to 
understand  dependencies. 

5.  Developed  a  document  structure  to  allow  better 

a)  Change  management  across  the  entire  program 

b)  Consistency  between  the  key  SE  artifacts 

6.  Demonstrate  role  based  access  to  SE  information  from  various  SE  artifacts 

7.  Built  on  existing  capabilities  of  the  Systems  Engineering  Toolkit  (SET)  developed 
by  UAHuntsville's  Rotorcraft  Systems  Engineering  and  Simulation  Center 
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Overview  of  the  Foundational  Tool 


Systems  Engineering  Toolkit 

(SET) 
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Systems  Engineering  Toolkit 


Web  based  tool  to  assist  in  Systems  Planning 

Uses  a  database  to  store  information,  providing  a  platform  for 

database-driven  documentation 

Internal  mapping  capabilities  to  provide  automatic  updating,  multiple 
document  creation  and  display  capabilities  relevant  to  a  type  of  user 
throughout  the  lifecycle 

Global  access  to  the  most  up-to-date  information 
Secure  and  controlled  access  to  documents 
No  installation  is  required 

-  Only  Requirements:  Internet  Explorer  with  Javascript  Enabled;  Adobe  Acrobat 
Reader  to  view  generated  documents 

Does  NOT  require  Java,  or  ActiveX  Plug-ins 

Welcome  to  the  System  Engineering  Toolkit(SET) 

Please  Log  In 

Itafname _ 

■  .  .  -  Password 

http://set.uah.edu/  fL 

RigaUt  fa  SET  fr-mooit  Hon  da  I  rcaialci  fa  SET? 

Eligibility:  DoD.  All  Service  Ranches.  Government  Quidcstart  Guide  How  do  I  gain  access  to  an  existing  document? 

Contractors  UflULdfiJ  mil  HU  naMwnfd? 

What  Is  sm 


5ET  Is  Patent  Pending  UAHuntsville  and  was  developed  In  partnership  w«tfi  PEO  Aviation  and  AMROEC 

UAHuntsville 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


6 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 

Systems  Engineering  Toolkit  -  Continued 


•  Presently  the  toolkit  assists  in  creating  SEPs  but  adaptable  and 
ready  to  assist  in  creating  a  multitude  of  documents 

•  The  tool  is 

—  Inquiry  driven 
—  Configuration  controlled 
—  Tailorable 

•  In  response  to  our  customers,  research  is  ongoing  to  further 
develop  the  tool  and  capabilities  with  funding  from  NAVAIR,  DoD, 
and  NASA  Marshall  Space  Flight  Center 


Welcome  to  the  System  Engineering  Toolkit  (SET) 

Please  log  in 

User  Name _ i 

Password  | _ 

|  Login  | 


New  User?  Help  FAQs 


Register  for  SET  Support  How  do  I  register  for  SET? 

Eligibility:  DoD,  All  Service  Quickstart  Guide  How  do  I  gain  access  to  an  existing 

Branches,  Government  Contractors  document? 

How  do  I  reset  mv  password? 

What  is  SET? 
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Systems  Engineering  Toolkit  -  SET  Benefits 


•  Benefits 

-  Global  access  to  the  most  up-to-date  information  and  guidance 

-  Decrease  document  creation  and  approval  timeline 

—  Ability  to  provide  more  consistency  across  the  programs 
documentation 

—  Capable  of  data  centric  verses  document  centric  focus 
—  Ability  to  leverage  strengths  of  other  projects/programs 
—  Uniformity  of  Process 
—  Minimal  training 

—  Customized  to  the  users  needs  while  in  conformance  to  DoD  guidance 
—  Team-Based  SEP  Generation  =  Consistent  Execution 
—  Minimize  "S  he  If- Ware" 

-  Means  to  collect  metrics  and  best  applied  practices 
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Systems  Engineering  Toolkit 
SEP  Preparation 


•  SEP  portion  of  the  tool  is 
created  from: 


Sampi.e  Format.  Milestone  A  Tki  hnouk.y  Development 


CONTENTS 


—  OSD  Preparation  Guide  V2.01  and 
Addendum 

—  DAG  Guide 

—  Briefings  from  OSD  on  SEP 
content 

•  Beta  Version  of  SET  released 
June  2007 

•  SET  Version  1.0  online  March, 
2008 

•  Presently  working  on  Version 
1.5,  anticipated  beta  release 
Feb,  2011 

http://set.uah.edu/ 


1.  Introduction . I 

U  Program  Description  and  Applicable  Documents  . . I 

1 2.  Current  Program  Status  . . . . . „ . . . . . . I 

1,3.  Approach  for  StP  Updates.. . . . . . . 

2.  Program  Requirements . 2 

2. 1 .  Capabilities.  Requirements,  and  C'onccpUs)  of  Operation . 2 

2.2.  Other  Requirements  Linked  to  the  Preferred  System  Concept ...................  2 

2.3.  Critical  Technologies . 3 

2.4.  Technology  Maturation  Cost  Schedule  Constraints...,.,..^. . . . ,4 

2.5.  Technology  Development  and  Involving  Acquisition  Strategy . . . . 4 

3.  Technical  Staffing  and  Organizational  Planning..*. . 5 

3. 1 .  Lead  Chief  Systems  Fnginccr  and  Functional  Leads . . . 5 

3.2.  IPT  Orgamaratioa'Stnicturc  . . ,6 

U  IPT  Staffing  Functional  Skills . < 

3.4.  IPT  Coordination  . . 6 

3.5.  Integration  with  Contractors  and  E.stcmal  Organizations . 7 

4.  Technology  .Maturation  and  Planning . 8 

4.1  Technology  Maturation  Responsibility . . K 

4.2.  Requirements  Traceability  and  Verification  and  Validation . 8 

4.3.  Technology  Maturation  and  Risk . . 

4  4.  Mapping  the  Technical  Baseline  to  the  Preferred  System  Concept  . .9 

4.5  Updating  and  Documenting  the  Preferred  System  Concept . . . „9 

5.  Technical  Review  Planning. . . . . . . . «* . «...  io 

5. 1 .  Event-Driven  Technical  Review's . . . 10 

5.2.  Technical  Review  Management  . . . . . ..... . . . 1 1 

5.3.  Chairing  of  Technical  Rev  iews . . . . . .. . 1 1 

5.4.  Stakeholder  Participation  tn  Technical  Reviews . . . 12 

5.5.  Peer  Participation  at  Technical  Reviews . . 12 

6.  Integration  with  Overall  Program  Management . 12 

6. 1  Linkage  with  Other  Program  Plans  . . 1 3 

6.2.  Use  of  Critical  Paths  and  Technical  Reviews . . . . 13 

6.3.  Risk  Management  Integration . . . 14 

6.4.  Test  and  Evaluation . . . . . .. . 14 

6.5.  Life-Cycle  Sustainment  Integration  . . 14 

6.6.  Contracting  Considerations . . . . ... . . . . . . . . 15 

ODUSD<  A&T)  System*  and  Software  Lngmeenng/Lntcrprac  Development  * 
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Systems  Engineering  Toolkit  -  Features 


Modular/adaptable  system  to  many  different 
documents  and  applications 

Customizable  for  individual  organizations  and  SE 
processes 


Account:  Sue  O’Brien  i Logout:  Active  SEP  Training  SEP 


Mapping  occurs  between  milestones,  guidance  and 
document  types 

Tailor  SEP  according  to 

—  Project/Program  Processes 

—  Project  Phase 

—  Family  of  Systems 

—  System  of  Systems 

—  ACAT  level 


ACAT  Level 

ACAT  1 

V 

FoS 

No 

V 

SoS 

No 

V 

Phase 

Concept  Refinement 

V 

Milestone 

A  v 

Version  No. 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 
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Systems  Engineering  Toolkit  -  Features 


Multiple  documents  per  user 
Multiple  permissions  per  user 
Incorporated  review  process 


Available  Documents 

Document 

Permissions 

Test  SEP 

Read.  Write 

TEST  SEP2V2 

Write 

LUH 

Read.  Write.  Review.  Admin 

Aviation  Svstems  Test  SEP 

Admin 

Tool  Demo 

Read.  Write.  Admin.  Version  Control 

Joint  Air  to  Ground  Missile  fJAGM) 

Read.  Peer  Approve.  Admin 

BlackHawk  UH60M 

Read.  Write.  Admin 

JAVELIN 

Write.  Admin 

AGSE  Practice  SEP 

Write.  Review.  Admin 

JPEO-CBD 

Admin 

Assessments  &  Support 


CRAM 


PEQ  CS&CSS  SET  Trial  SEP 


Training  SEP 


Training  Demo 


Joint  Chem  Bio  Practice  SEP 


Training  Denio  I 


MFOQA  Field  Prototype  Project 


Aerial  Common  Sensor 


Make  a  comment  regarding  this  question 

Once  the  comment  is  submitted,  the  section  will  be  open  for  editing  by  the  writers. 

Comment 

B  /  U  X2  X,  j=  ^  £ .  «%  V* 


Make  Comment 


Training  Demo  Approval  Sheet 

Refresh  Generate  Draft  Print 

Priority  Category:  Critical:  A  change  that,  if  not  corrected,  would  result  in  a  non-concurrence:  Significant:  A  substantive  concern  that  must  be  considered;  Administrative:  Editorial  in  nature. 

My  Comments 


CMT# 

Section 

Para  /  Fiaure  /  Table 

Priority 

Comment 

[Rationale 

1 1.2  Current  Program  Status 

m 

Critical 

- 

X 

Submit  Comments 


Approve  Document 


All  Approvers'  Comments 

ICMT# 


lApprt 


[Section  ~ 


|Para/ Figure /Table 


[Priority 


[Com  ment 


[Rationale 


Peer  Approver  Comments 

|CMT# 


|Appr( 


[Section 


|Para/  Figure  /Table 


[Comment 


[Rationale 


©2007  UAHuntsville 
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Systems  Engineering  Toolkit  -  Features 


•  Allows  multiple  users  and  user  types  to  work  on  the  same 


document  at  any  time 
•  Enhanced  communications 

»  Gain  knowledge  from  other  projects  and  organizations 


a.  What  is  the  approach  for  requirements  traceability?  What  is  the  approach  for  requirements  verification  and 
validation  traceability? 

Page  being  edited  by  Lance  Warden 

a.  What  is  the  approach  for  requirements  traceability?  What  is  the  approach  for  requirements 
verification  and  validation  traceability? 

B  /  U  <>  0  ?  m  g  i  L 

System  requirement  traceability  is  provi 

Requirement  traceability  for  the  UH-60D 

A 

DM  ORD  to  the  Functional  Baseline  top  System 

UH-60M  Functional  Baseline  is  accomplished  via 
le  one  developed  by  Sikorsky  utilizing  the  SE 
s  able  to  trace  performance  requirements  in  section  3 
there  traceability  is  further  carried  down  to  the 
•r  the  SRS.  Segment  Specifications  and  the  SRS 

Product  Baseline  Detail  Specifications  and  or 

a  ♦>or'»11a1  fr'»/»a'»U<1<ftr  fli  a  Q^rpfatvt  1?  a/ni*ratvia*ifr 

Reviewer  Comments 

System  requirement  traceability  is  provided  from  the  LH-61 
Performance  Specification.  Requirement  traceability  for  the  1 
two  independent  database  systems.  The  primary  system  is  tl 
software  tool  DOORSTM.  Within  that  database  Sikorsky  i 
to  each  of  the  Verification  Requirements  in  section  4.  From  1 
appropriate  Allocated  Baseline  Segment  Specification  and  o 
requirements  are  then  traced  to  the  appropriate  lower  level  1 

Notes 

1  _  ^1 

Date  Reviewer  Comment 
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Systems  Engineering  Toolkit  -  Features 


Navigation 
tree  based 
on  SEP 
Preparation 
Guide  TOC 


Colored 

Status 

Indicators 


Generate  Reports 

Manage  Users 

Configure  SEP 
Title  &  Coordination 

Approval  Sheet 


Mv  Page 


Based  on  OSD  Guidance 
-  Introduction 

H.1  Program  Description 
and  Applicable  Documents 
1 1 .2  Current  Program 
Status 

■  1 .3  Approach  for  SEP 
Updates 

B2  Program  Requirements 
ft 3  Technical  Staffing  and 
Organizational  Planning 
ft 4  Technology  Maturation 
and  Planning 
ft 5  Technical  Review 
Planning 

ft 6  Integration  with  Overall 
Management  of  the  Program 


Attachments 

Images 
Acronym  List 


UAH 


Webmaster  Contact  Us 

Disclaimer  FAQ 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 


Account:  Sue  O'Brien  (Logout:  Active  SEP:  Tool  Demo 

Available  Documents 


Test  SEP 


TESTSE-2V2 


LUH 


Document 


Permissions 


Read.  Approve.  Write 


Write 


Admin 


Aviation  Sy  stems  :  est  SEP 


Tool  Demo 


Joint  Air  to  Ground  Missile  (JAbM: 


BlackHawk  UH6QM 


JAVELIN 


Multiple  SEPs 
and  Permission 
Levels  Available 
to  Users 


Admin 


Write.  Admin.  Version  Control 


Write  Peer  Approve  Admin 


Admin 


Admin 


Messages 


Message 

Area 


|Date 


From 


| Subject  ' 


Section  Change  Log 


Section 

Editor 

Date 

2  1  i  Table  of  KPPs 

Lisa  Liever 

22-APR-2008 

3.5  a  How  will  the  Droaram  facilitate  interaction  amona  the  SE  Workina-level  Intearated  Product  Teams  (WIPT).  other 

Dawn  Sabados 

19-MAR-2008 

government  organizations  and  contractors  (as  aDDlicable)  on  technical  tasks  activities  and  resoonsibilities  te  a 

requirements,  technical  baseline,  technical  reviews)?  How  will  the  proaram  s  organization  and  structure  facilitate  clear 

communication  of  technical  guidance  amona  these  organizations  engaged  in  SE  activities?  How  will  technical  review  entrance 

and  exit  criteria  be  handled  between  these  organizations?  How  will  the  SE  WIPT  contribute  to  and  document  the  technical 

and  management  aDDroach?  ^ 

Account  Options 

User  Options 
Change  Password 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 
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Systems  Engineering 

Selecting  a 


Toolkit  -  Features 
Section 


Generate  Reports 

Manage  Users 

Configure  SEP 
Title  &  Coordination 

Approval  Sheet 


Mv  Page 


Based  on  OSD  Guidance 
-  Al  Introduction 

■  1.1  Program  Description 
and  Applicable  Documents 

■  1 2  Current  Program 
Status 

■  1 .3  Approach  for  SEP 
Updates 

+  fi2  Program  Requirements 
Technical  Staffing  and 
Organizational  Planning 
+  fi4  Technology  Maturation 
and  Planning 

Technical  Review 
Planning 

+  fi6  Integration  with  Overall 
Management  of  the  Program 


Attachments 

Images 
Acronym  List 


UAH 


Webmaster  Contact  Us 

Disclaimer  FAQ 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 


Account:  Sue  O'Brien  ( Logout:  Active  SI 


All  Questions  for 
Chapter  1 .2 


[Section  not  complete.  Cannotjpi^submitted  at  this  time. 

Current  Program  Status  ** 


□ 


v 


0  a  Summarize  the  overall  Acquisition  Strategy  emphasizing  that  it  is  event  driven. 

0  b  Provide  a  program  schedule  which  shows  major  milestones:  SE  technical  reviews:  and  notional  dates  for  imjor  events 
(developmental,  operational,  and  live  fire  test  phases:  deliveries,  certifications:  contract  awards:  training:  site  aor^jon.  etc.) 

0  c  Highlight  the  major  activities  that  the  program  conducted  to  date  such  as  outcomes  of  technical  reviews,  test  phased 
independent  reviews,  risk  reduction  activities,  trade  studies,  etc. 

0e  What  technical  refreshes  are  planned  in  the  System  Development  and  Demonstration  (SDD)  phase? 

0f  What  are  the  top-level  risks  associated  with  technology  and  risk  closure  plans?  Note:  there  is  discussion  of  risk  in  sections  4.5 
an^^Referencing  these  sections  may  be  appropriate. 

0g  How  wflKhe  technical  requirements  and  technical  risks  be  addressed  given  program  funding  and  schedule  constraints? 

□  d.  How  does  the  Acqu^lion  Strategy  mitigate  the  technical  risks  associated  with  technology  maturation  or  obsolescence  as  well 
as  the  maturity  of  technologi^g  be  used? 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 
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Preview 


Click  on  question  to 
open  individual  text 
boxes 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


14 


UAHuntsville 


Systems 


Engineering  Toolkit  -  Features 
Selecting  a  Question 


O'Brien  /  Se 


Generate  Reports 

Manage  Users 
Title  &  Coordination 

Approval  Sheet 


Mv  Page 


Based  on  OSD  Guidance 
+  fll  Introduction 
-  (B-2  Systems  Engineering 
Application  to  Life  Cycle 
Phases 

+  B2.1  System  Capabilities, 
Requirements,  and  Design 
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+  B2.2  Systems  Engineering 
,  sanizational  Structure 

■  B;  stems  Engineering 

Pr< 

■B:  chnical 

Me  ment  and  Control 

■  B;  egration  with  Other 

Pn  \lanagement 

Cc  Effects 


Attachments 

Images 
Acronym  List 
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Disclaimer  FAQ 
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b.  Given  the  Requirements  outlined  in  System  Capabilities,  Requirements,  and  Design  Considerations,  who  are  the 
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[The  SE  Directorate  is  organized  to  support  each  JAMS  Product  and  SE  functional  area.  The  JAGM  system  Division  Chiej^^Tie  JAGM 
system  LSE  and  coordinates  with  the  Navy  counterpart  LSE.  The  LSE's  primary  responsibility  is  the  day-to-day  application  of  systems 
engineering  principles,  processes,  and  products  and  coordinates  with  the  SE  Director,  the  JAGM  system  Product  Manager,  and  JAMS 
Project  Manager  (PM)  through  joint  IPT  process. 
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The  Baseline  UH-60M  is  nearing  the  end  of  the  SDD  Phase  of  the  program.  IOT&E  is  schedule  for  July  2006,  LFT&E  is 
ongoing  through  the  end  of  2006,  and  EMV  testing  takes  place  from  September  2005  through  February  2006.  The  first  four 

1 Q  aircraft  have  been  delivered,  die  last  four  IQ  aircraft  are  in  production  and  the  LRIP  contract  has  just  been  signed.  These 
last  I  Q  aircraft  and  the  first  two  LRIP  aircraft  are  production  representative  and  will  take  part  in  the  IOT&E  which  is 
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Help  for  ’’Summarize  the  overall  Acquisition  Strategy  emphasizing  that  it  is  event  driven.” 

Source:  Systems  Engineering  Plan  Preparation  Guide,  Version  2.01,  page  A-1. 

(Department  of  Defense,  Office  of  the  Deputy  Under  Secretary  of  Defense  for  Acquisition  and 
Technology,  Systems  and  Software  Engineering,  Enterprise  Development) 

1.2  Current  Program  Status 

Summarize  the  overall  Acquisition  Strategy  and  how  it  is  event  driven.  Discuss  how  the  technical 
requ 
the  n 
indej 


b.  Enter  a  top-level  system  description  conveying  overall  key  aspects  of  the  program.  Include  a  notional 
diagram  of  the  system.  Use  the  appropriate  DoD  Architecture  Framework  views  (e.g.  Operational  View-1). 
(When  referencing  details  in  other  documents,  reference  by  section  and  page  of  the  document.) 
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The  system  will  be  an  precision  guided  missile  and  launcher  for  use  by  joint  service  manned  and  unmanned  aircraft  to  destroy  high  value 
stationary,  mo\ing:  and  relocatable  land  and  naval  targets.  The  system  will  be  capable  of  providing  both  current  and  future  aviation 
platforms  with  reactive  targeting  capabilities  satisfying  the  sum  of  needs  across  the  joint  platforms,  and  eliminating  the  requirement  for 
separate  upgrades  to  multiple  existing  missile  systems.  The  system  will  consist  of  several  integrated  subsystems  onto  various  rotary  wing, 
fixed  wing  and  Unmanned  Aerial  System  (UAS)  platforms,  as  well  as  associated  trainers,  test  sets  and  support  equipment.  The  F  A- 18 
E  F  Super  Hornet,  AH-64D  Apache,  and  AH-1Z  Cobra  are  MS  C  threshold  platforms  with  integration  occurring  no  later  than  (NLT) 
the  end  of  FY  and  fielding  NLT  the  end  of  FY  (refer  to  2.1.5).  Other  threshold  platforms  are  the  ARH-70  Arapaho,  MH-60R  Seahavvk, 
and  Extended  Range  Multi-Purpose  (ERMP)  UAS. _ 
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document  generation  and  review  process  that  works  for  your 
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flexibility 

•  -  Peer  roles  do  not  effect  document  processing,  inputs  are  merely  advise. 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


19 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 

Systems  Engineering  Toolkit  -  Process 
Document  Development. 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


20 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 


Mapping  and  Tailoring 


Guide  V  1.02 


Guide  V  2.1  +  Addendum 


1.0  Introduction 

1.1  Program  Description  and  Applicable  Documents 

1.2  Program  Technical  Status  at  Time  of  SEP  Submittal 

1.3  Approach  for  Updating  SEP 
2.0  Systems  Engineering  Application  to  Life  Cycle  Phases 

2.1  System  Capabilities,  Requirements,  and  Design  Considerations 

2.1.1  Capabilities  to  be  Achieved 

2.1.2  Key  Performance  Parameters 

2.1.2.1  Individual  KPPs 

2.1.3  Statutory  and  Regulatory  Requirements 

2.1.4  Certification  Requirements 

2.1.5  Design  Considerations 

2. 1.4.1  Design  Constraint  Subsections 

2.2  Systems  Engineering  Organizational  Structure 

2.2.1  Organization  of  IPTs 

2.2.1.1  Individual  IPTs 

2.2.2  Organizational  Responsibilities 

2.2.2.1  Additional  Subsections 
2.23  Integration  of  SE  into  Program  IPT's 

2.2.4  Technical  Staffing  Plan 

2.3  Systems  Engineering  Process 

2.3.1  Process  Selection 

2.3.2  Process  Improvement 

2.3.3 Tools  and  Resources 

2.3.3.1  Test  and  Evaluation 

2. 3.3.2  Modeling  and  Simulation 

2.3. 3.3  Measures  of  Effectiveness 

2.3.4  Approach  for  Trades 

2.4  Technical  Management  and  Control 

2.4.1  Technical  Baseline  Management  and  Control  (Strategy  and  Approach) 

2.4.2  Technical  Review  Plan  (Strategy  and  Approach) 

2.4.2.1  Technical  Reviews 

2.5  Integration  with  Other  Program  Management  Control  Efforts 

2.5.1  Acquisition  Strategy 

2.5.2  Risk  Management 

2.5.3  Integrated  Master  Plan 

2.5.4  Earned  Value  Management 

2.5.5  Contract  Management 


1.0  Introduction 

1.1  Program  Description  and  Applicable  Documents 

1.2  Current  Program  Status 

1.3  Approach  for  SEP  Updates 
2.0  Program  Requirements 

2.1  Capabilities  and  Key  Performance  Parameters 

2.2  Statutory  and  Regulatory  Requirements 

2.3  Specified  and  Derived  Requirements 

2.4  Certification  Requirements 

2.5  Design  Considerations 

2.6  Individual  Design  Considerations 

3.0  Technical  Staffing  and  Organizational  Planning 

3.1  Lead/Chief  Systems  Engineer  and  Functional  Leads 

3.2  IPT  Organization/Structure 

3.3  IPT  Staffing/Functional  Skills 

3.4  IPT  Coordination 

3.5  Integration  with  Contractors  and  External  Organizations 
4.0  Technical  Baseline  Management 

4.1  Technical  Baseline  Management  Responsibility 

4.2  Defining,  Approving  and  Maintaining  the  Technical  Baseline 

4.3  Requirements  Traceability  and  Verification  and  Validation 

4.4  Specification  Tree  and  WBS  Link 

4.5  Technical  Maturity 

5.0  Technical  Review  Planning 

5.1  Event-Driven  Technical  Reviews 

5.2  Technical  Review  Management 

5.3  Chairing  of  Technical  Reviews 

5.4  Stakeholder  Participation  in  Technical  Reviews 

5.5  Peer  Participation  at  Technical  Reviews 

6.0  Integration  with  Overall  Management  of  the  Program 

6.1  Linkage  to  Other  Program  Management  Plans 

6.2  Program  Manager's  Approach  to  Using  Technical  Reviews 

6.3  Risk  Management  Integration 

6.4  Test  and  Evaluation 

6.5  Sustainment  Integration 

6.6  Contracting  Considerations 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


21 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 

Mapping  and  Tailoring 
Creating  and  Mai ntaining  a  Living  SEP 


MSA 


MS  B 


MS  C 


1.0  Introduction 

1.1  Program  Description  and  Applicable  Documents 

1.2  Current  Program  Status 

1.3  Approach  for  SEP  Updates 
2.0  Program  Requirements 

2.1  Capabilities,  Requirements  and  Concept(s)  of  Operation 

2.2  Other  Requirements  Linked  to  the  Preferred  Systems  Concepts 

2.3  Critical  Technologies 

2.4  Technical  Maturation  Cost  /  Schedule  Constraints 

2.5  Technology  Development  and  Evolving  Acquisition  Strategy 

3.0  Technical  Staffing  and  Organizational  Planning 

3.1  Lead/Chief  Systems  Engineer  and  Functional  leads 
3 2  IPT  Organization/Structure 

3.3  IPT  Staffing/Functional  Skills 

3.4  IPT  Coordination 

3.5  Integration  with  Contractors  and  External  Organizations 
4.0  Technology  Maturation  and  Planning 

4.1  Technology  Maturation  Responsibility 

4.2  Requirements  Traceability  and  Verification  and  Validation 

4.3  Technology  Maturation  and  Risk 

4.4  Mapping  the  Technical  Baseline  to  the  Preferred  System  Concepts 

4.5  Updating  and  Documenting  the  Preferred  System  Concepts 

5.0  Technical  Review  Planning 

5.1  Event-Driven  Technical  Reviews 

5.2  Technical  Review  Management 

5.3  Chairing  of  Technical  Reviews 

5.4  Stakeholder  Participation  in  Technical  Reviews 

5.5  Peer  Participation  at  Technical  Reviews 
6.0  Integration  with  Overall  Management  of  the  Program 

6.1  Linkage  with  Other  Program  Plans 

6.2  Use  of  Critical  Paths  and  Technical  Reviews 

6.3  Risk  Management  Integrations 

6.4  Test  and  Evaluation 

6.5  Life-Cycle  Sustainment  Integration 

6.6  Contraction  Considerations 

6.7  Item  Unique  Identification  Implementation  Plan 


►  1.0  Introduction 

1.1  Program  Description  and  Applicable  Documents 
1 J.  Current  Program  Status 

1.3  Approach  for  SEP  Updates 
2.0  Program  Requirements 

2.1  Capabilities  and  Key  Performance  Parameters 

2.2  Statutory  and  Regulatory  Requirements 

2.3  Specified  and  Derived  Requirements 

2.4  Certification  Requirements 

2.5  Design  Considerations 

2.6  Individual  Design  Considerations 
3.0  Technical  Staffing  and  Organizational  Planning 

3.1  Lead/Chief  Systems  Engineer  and  Functional  Lea< 

3.2  IPT  Organization/Structure 

3.3  IPT  Staffing/Functional  Skills 

3.4  IPT  Coordination 

3.5  Integration  with  Contractors  and  External  Organizations 
4.0  Technical  Baseline  Management 


4.1  Technical  Baseline  Management  Responsibility 

4.2  Defining,  Approving  and  Maintaining  the  Technical  Baseline 

4.3  Requirements  Traceability  and  Verification  and  Validation 

4.4  Specification  Tree  and  WBS  Link 

4.5  Technical  Maturity 
5.0  Technical  Review  Planning 

5.1  Event-Driven  Technical  Reviews 

5.2  Technical  Review  Management 

5.3  Chairing  of  Technical  Reviews 

5.4  Stakeholder  Participation  in  Technical  Reviews 

5.5  Peer  Participation  at  Technical  Reviews 
6.0  Integration  with  Overall  Management  of  the  Program 

6.1  Linkage  to  Other  Program  Management  Plans - 

6.2  Program  Manager's  Approach  to  Using  Technical  Reviews 

6.3  Risk  Management  Integration 

6.4  Test  and  Evaluation 


6.5  Sustainment  Integration 
6.6  Contracting  Considerations 


1.0  Introduction 

1.1  Program  Description  and  Applicable  Documents 

1.2  Current  Program  Status 

1.3  Approach  for  SEP  Updates 
2.0  Program  Requirements 

2.1  Technical  Oversight  Approach 

2.2  Comparison  of  Data  to  Planning  Assumptions 

2.3  Use  of  Data  to  Continuously  Monitor  the  System 

2.4  Production  and  Design  Driven  Operations  and  Support  Cost 

2.5  Configuration  Changes 

3.0  Technical  Staffing  and  Organizational  Planning 

3.1  Lead/Chief  Systems  Engineer  and  Functional  Leads 

3.2  IPT  Organization/Structure 

3.3  IPT  Staffing/Functional  Skills 

3.4  IPT  Coordination 

3.5  Integration  with  Contractors  and  External  Organizations 
4.0Technical  Baseline  Management 

4.1  Technical  Baseline  Management  Responsibility 
4.2Technical  Baseline  Control 

4.3  Requirements  Tractability  and  Verification  and  Validation 

4.4  Technical  Baseline 

4.5  Technical  Approach  to  Assess  Risk 
5.0  Technical  Review  and  Audit  Planning 

5.1  Event-Driven  Technical  Reviews  and  Audits 

5.2  Responsibility  for  Technical  Reviews  and  Audits 

5.3  Chairing  of  Technical  Reviews  and  Audits 

5.4  Stakeholder  Participation  at  Technical  Reviews  and  Audits 

5.5  Peer  Participation  at  Technical  Reviews  and  Audits 
6.0  Integration  with  Overall  Management  of  the  Program 

6.1  Program  Management  Planning  and  Control 

6.2  Program  Manager's  Role  in  Technical  Review 

6.3  Risk  Management  Integration 

6.4  Test  and  Evaluation 

6.5  Life-Cycle  Sustainment  Integration 

6.6  Contracting  Considerations 


As  a  program  progresses  through  the  lifecycle,  contents  automatically  update  to 
reflect  the  Milestone,  and  pertinent  text  is  flowed  forward. 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


22 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 


Tree  Editor  for  the  Mapping  Process 


^SET  -  Tiee  Editor  -  Windows  Internet  Exploiei 

- mi 

IfJ^  https  uah.edu 

M  M  *  w 

ipedla  1 1  <P 

File  Edit  View  Favorites  Tools  Help  X  ^Convert  ▼  £§  Select 

*  Favorites  ^  ’&  "  C  Free  Hotmail 

$  SET  -Tree  Editor 

a-  s 

0R5  »  Page  ▼  Safety  ▼  Tools » 

Tree  Editor 


SEPV2.A 


•  iROOT 
+  introduction 
+  iProgram  Requirements 
-  ^Technical  Staffing  and  Organizational  Planning 
?  Briefly  introduce  this  chapter  with  a  general 
description  of  how  the  program  will  organize  and 
staff  SE  activities  to  meet  the  requirements  of  the 
supported  milestone  and  phase 
+  iLead/Chief  Systems  Engineer  and  Functional 
Leads 

+  iPT  Organization/Structure 
+  iPT  Staffmg/Functional  Skills 
-  iPT  Coordination 

+  integration  with  Contractors  and  External 
Organizations 

+  ^Technology  Maturation  and  Planning 
+  ^Technical  Review  Planning 
+  integration  with  Overall  Management  of  the 
Program 


Node  Information 

Label 


Instructions 


Tailoring  Rules 


Position 


(Optional) 

[Parametei 


Rule 


GEH^EE 

SEPV2 A 

ixl 

ROOT 

u 

Introduction 

Iris] 

Parent 
-  iROOT 
+  introduction 
+  iProgram  Requirements 
+  ^Technical  Staffing  and 
Organizational  Planning 


Previous  Sibling 


[  Save  |  |  Revert  Changes  )  [  Delete  Node 


mm 


Delete  Element  And  Node 


©2007  UAHuntsville 


Internet 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


23 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 


Department  of  Defense  (DoD) 
SET  Version  1.0 


r - — - — ^ 

Generate  Reports  Mv  Page 
Manage  Users 

Configure  SEP 
Title  &  Coordination 

Approval  Sheet 


Based  on  OSD  Guidance 
-  B'l  Introduction 

■  1  1  Program  Description 
and  Applicable  Documents 

■  1 .2  Current  Program 
Status 

■  1 .3  Approach  for  SEP 
Updates 

+  fi2  Program  Requirements 
+  fi3  Technical  Staffing  and 
Organizational  Planning 
+  fi4  Technology  Maturation 
and  Planning 
+  Technical  Review 
Planning 

+  ®6  Integration  with  Overall 
Management  of  the  Program 


Attachments 

Images 
Acronym  List 


*  9 

Webmaster  Contact  Us 

Disclaimer  FAQ 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 


Account:  Sue  O’Brien  I'LocfOut!  Active  SEP:  Tool  Demo 


|Section  not  complete.  Cannot  be  submitted  at  this  time" 


Current  Program  Status 

0  a  Summarize  the  overall  Acquisition  Strategy  emphasizing  that  it  is  event  driven. 

0  b  Provide  a  program  schedule  which  shows  major  milestones;  SE  technical  reviews;  and  notional  dates  for  major  events 
(developmental,  operational,  and  live  fii 


□ 


0  c.  Highlight  the  major  activities  thatt 
independent  reviews,  risk  reduction  ad 

0e  What  technical  refreshes  are  plan 

0f.  What  are  the  top-level  risks  associ 
and  6.3.  Referencing  these  sections  mi 

0  g  How  will  the  technical  requiremen 


□  d  How  does  the  Acquisition  Strateg 
as  the  maturity  of  technologies  to  be  us 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 


Generate  Reports  My  Page 

Manage  Users 

Title  &  Coordination 

Approval  Sheet 

Based  on  OSD  Guidance 
♦fii  Introduction 
-  B-2  Systems  Engineering 
Application  to  Life  Cycle 
Phases 

+  fi2.1  System  Capabilities, 
Requirements,  and  Design 
Considerations 
+  ®2.2  Systems  Engineering 
Organizational  Structure 
+  fi2.3  Systems  Engineering 
Process 

♦fi2  .4  Technical 
Management  and  Control 
+  ®2.5  Integration  with  Other 
Program  Management 
Control  Effects 

Attachments 

Images 

Acronym  List 


UAH 


Webmaster  Contact  Us 

DLsclaimer  FAQ 

©2007  All  Rights  Reserved  UAH 
Patent  Pending 


Account:  Sue  O'Brien  (Logout!  Active  SEP:  Joint  Air  to  Ground  Missile  (JAGM) 


b.  Given  the  Requirements  outlined  in  System  Capabilities,  Requirements,  and  Design  Considerations,  who  are  the  j 
appropriate  technical  authorities?  I — 


b / nEfi, 


[The  SE  Directorate  is  organized  to  support  each  JAMS  Product  and  SE  functional  area.  The  JAGM  system  Dhision  Chief  is  the  JAGM 
system  LSE  and  coordinates  with  the  Navy  counterpart  LSE.  The  LSE's  primary  responsibility  is  the  day-to-day  application  of  systems 
engineering  principles,  processes,  and  products  and  coordinates  with  the  SE  Director,  the  JAGM  system  Product  Manager,  and  JAMS 
Project  Manager  (PM)  through  joint  IPT  process. 


<>©  ?  13  §1 


Para  with  reference  to  SEIT  was  moved  to  2.. 


Reviewer  Comments 
i  |Reviewer 


|Comment~ 


©2007  All  Rights  Reserved  UAH 
Patent  Pending 


O'Brien  /  Sept,  14,  2010 


Rotorcraft  System  Engineering  and  Simulation  Center 


24 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 


Department  of  Defense  (DoD) 

SET  Version  1.5 
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1  Introduction 

1.1  Program  Description  and  Applicable  Documents 

a.  OV-1  Showing  the  operational  environment 

[Diagram  Here] 

b.  Business  Case 


□  0 


Linkages 


Due  to  the  current  costs  associated  with  the  existing  lack  of  situational  support,  and  the  current  support  for  this  solution  by  our  partner  organizations  there  is  |  Linkages 
sufficient  need  and  funding  to  proceed  with  this  project 

c.  System  Description  and  Configuration 


The  system  will  be  composed  of  modular  components  which  will  integrate  to  meet  mission  requirements.  These  components  will  be  configured  using  a 
configuration  system  which  both  provides  ease  of  configuration  as  well  as  ensures  optimal  configuration 

d.  System  Description  and  Configuration  -  Key  features 

The  systems  key  features  will  include  it's  ease  of  use  and  ability  to  support  optimal  configurations. 

e.  Threat  Environment 

The  threat  environment  will  be  complex  and  will  be  determined  primarily  by  the  theater  of  operations. 

f.  Evaluation  Framework 


1.2  Current  Program  Status 
a.  Acquisition  Strategy  Overview 


Linkages 


Linkages 


Linkages 


Linkages 
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Research  Leading  to  SET  Version  1.5 


Research  Method 
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The  RSESC  team  analyzed  existing 
documents  and  guidance  to  identify 
common  topic  areas  and  subsequently 
implemented  mapping  into  the  tool. 
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Procedures 


1.  Analyze  existing  SEPs,  TEMPs,  and  ISP  standards,  guidance, 
instructions  and  examples 

2.  Dissect  existing  guidance  and  approved  plans  to  determine 
topic  areas,  correlations  and  dependencies 

3.  Develop  the  table  of  contents  for  the  SEP,  TEMP  and  ISP 
within  the  SET  tool  and  map  high  level  topic  areas  into  the 
appropriate  section 

4.  Create  a  role  based  system  for  creating  project 
documentation 

5.  Create  linkages  between  the  three  documents  in  SET  using 
identified  correlations  and  dependencies 
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The  following  terms  have  been  defined  for  use  in  breaking  down 
and  mapping  content  within  and  between  documents: 

Correlated  Information  -  Duplicate  topic  information  found  in  more  than  one 
document  with  only  one  governing  entity 

-  Governing  Document  -  Topic  areas  are  dependent  on  specific  documents  such 
as  the  SEP,  TEMP,  ISP,  etc. ,  not  necessarily  a  particular  role  or  SME.  The 
governing  document  controls  the  content  and  changes  to  that  content  for  a 
subject  area.  (Generic  roles:  reader,  writer,  reviewer,  approver,  version 
controller) 

-  Governing  Role  -  Independent  topic  areas  and  not  governed  by  a  specific 
document.  This  information  would  be  changed  by  preapproved  individual 
roles.  Changes  to  the  information  is  not  governed  by  the  document.  (Specific 
Roles:  PM,  LSE,  SMEs,  Logisticians,  etc.) 

•  Dependent  Information 

-  Level  1:  High  level  details  about  a  topic  area.  An  overview  on  how  processes 
will  be  handled.  Should  be  consistent  with  Level  2  information. 

—  Level  2:  Lower  level  more  specific  information  that  falls  in  line  with  the  Level  1 
information  but  has  much  more  detail  specifics. 
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Level  1/Level  2  Example 
SEP  and  TEMP  Dependency 


The  IPTs  for  the  program  are  listed  as  product  teams  across  the  bottom  of  Figure  15. 

The  IPT  Leads  have  responsibility  and  authority  (within  the  bounds  of  the  contract)  for  cost, 
schedule,  and  technical  accomplishment  for  what  tasks  needs  to  be  done  and  when  they  need  to  meet 
program  objectives.  In  that  role,  they  direct  the  day-to-day  tasking  of  resources  toward  IPT  objectives. 

The  IPTs  have  responsibility  to  ensure  that  processes  and  procedures  are  being  followed  and 
providing  a  properly  trained  staff.  In  essence,  the  functional  leads,  including  engineering,  have 
responsibility  and  authority  for  how  a  task  is  accomplished  and  by  whom. 

There  exists  an  open  and  informal  communication  channel  across  the  various  teams  involved  in 
the  development  of  the  program.  Emphasis  is  placed  on  cross-communication  beginning  at  the  Subject 
Matter  Expert  (SME)  level  with  the  IPT  lead  being  informed  of  issues  or  risks.  When  a  change  in  the 
scope  of  tasks  arises,  the  contractual  communication  channels  are  adhered  to.  Figure  16  depicts  the 
communication  guidelines  between  development  teams. 

Figure  17  depicts  the  formal  communication  . . . 

Specific  details  about  the  individual  IPTs  can  be  found  in  the  following  documents: 


Level  1 
Detail 
(General) 


IPT  Specifics 

Team  Charters 

Test  and  Evaluation  IPT 

TEMP 

Logistics  IPT 

Software  and  Simulation  IPT 

.  .  . 

Level  2 
Detail 
(Specific) 
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Level  1/Level  2  Example 

- SEP  and  JEM  P  Dependency - 

•  SEP  Level  1 

—  1.2  Current  Program  Status  Highlight  the  major 
activities  that  the  program  conducted  to  date  such 
as  outcomes  of  technical  reviews,  test  phases, 
independent  reviews,  risk  reduction  activities, 
trade  studies,  etc. 

•  TEMP  Level  2 

—  1.3. 2.1.  Previous  Testing.  Discuss  the  results  of  any 
previous  tests  that  apply  to,  or  have  an  effect  on, 
the  test  strategy. 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


31 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 


Breakdown  of  the  Documents 


Topic  Areas 

Level 

Governing  Entity 

TEMP  Section 

SEP  Section 

Milestone 

ISP 

ISP  Example 

(DODI/DAG) 

Mission  Need 

1 

Role  Based/SME 

1.2 

2 

A,  B,  and  C 

2.1 

2.1 

Supported  Capability 

2 

Role  Based/SME 

2.2 

2.2 

OV-1  Showingthe  operational  environment 

1 

Role  Based/SME 

1.2 

1.1 

A,  B,  and  C 

1.1 

1.1 

Organizations  which  the  system  will  be  integrated  (if  applicable 

1 

Role  Based/SME 

1.2 

3.5 

A,  B,  and  C 

1.1 

1.1.1 

Role  Definitions 

2 

Role  Based/SME 

1.3 

1.3 

Business  Case 

1 

Role  Based/SME 

1.2 

1.1 

A,  B,  and  C 

System  Description  and  Configuration 

1 

Role  Based/SME 

1.3 

1.1 

A,  B,  and  C 

1.1 

1.1 

Key  features 

2 

Role  Based/SME 

1.3 

1.1 

A,  B,  andC 

1.1 

1.1 

Required  Capabilities 

2 

Role  Based/SME 

2.4 

2.4 

Threat  Environment 

1 

Role  Based/SME 

1.3.1 

1.1 

A,  B,  andC 

1.1 

1.1 

Analysis  of  Alternatives 

1 

Role  Based/SME 

1.3.2 

4.4 

A 

Appendix  A 

Touches  on  this  in  1.1.1 

refers  to  it 

and  1.3. 2.1  but  no  big 

discussion 

1  Acquisition  Strategy  Overview 

1 

Role  Based/SME 

1.3.2 

1.2 

A,  Br  and  C 

Touches  on 

evolutionary  acquisition 
in  2.1  an  2.13  but  no  big 

1  Previous  Testing 

1 

Document  Based./TEMP 

1.3. 2.1 

1.2 

A,  B,  and  C 

(Considered  6.4  but 
since  can  only  one 

chose  1.2) 

KPPs,  KSAs 

1 

Role  Based/SME 

1.3.3 

2.1 

A,  B,  and  C 

Referenced  but  not 

Data/Information  Flow 

1 

Document  Based/SEP 

2.2 

4. 5  A 

4.2B 

4.2C 

TEMP  Deficiency  Reporting 

2 

Document  Based./TEMP 

2.3 

6.4 

6.4C 

Data  Quality  Requirements 

2 

Document  Based/ISP 

2.4 

2.4 

System  Data  Exchange 

2 

Role  Based/SME 

Appendix  B 

Appendix  B 

Data  Timeliness 

2 

Document  Based/ISP 

2.5 

2.5 

The  Systems  Engineering  Toolkit  will  be  used  to  provide  linkages  of  multiple 
documents  within  one  database.  It  will  allow  topic  searches  across  multiple 


documents  to  ensure  consistency  and  efficient  SE  planning, 
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Modularity  Results 


•  When  examining  the  topic  areas,  seventy-six  topic 
areas  were  in  common  between  at  least  two  of  the 
three  documents 


Document 

Topic  Areas  with  Commonality 

Percent  Commonality 

SEP 

52 

68% 

TEMP 

49 

64% 

ISP  (DODI/DAG) 

21 

28% 

ISP  (Example) 

24 

32% 
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Modularity  Results 


•  When  examining  the  Table  of  Contents  from  each 
of  the  three  documents 


Document 

Total 

Number  of 
Sections 

Number  of 
Orphan 
Sections 

Number  of  Sections 

with  Common 
Information 

Percent 

Common 

SEP  MSA 

29 

10 

19 

65.5% 

SEP  MS  B 

29 

11 

18 

62.1% 

SEP  MS  C 

29 

13 

16 

55.2% 

TEMP 

57 

26 

32 

56.1% 

ISP  (DODI/ 
DAG) 

23 

9 

14 

60.8% 
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Mapping  Between  Documents 


TEMP 


1.1  Purpose 

1.2  Mission  Description 

1.3  System  Description - 

1.3.1  System  Threat'" 

1.3.2  Program  Background 

1. 3.2.1  Previous  Testing  \ 

1.3.3  Key  Capabilities  '  C 


1.3.3.1  Key  Interfaces 

1.3.3.2  Special  test  for  certification  requirements  •- 
1.3.3.3  System  Engineering  (SE)  Requirements 

2.1  T&E  Management 
2.1.1  T&E  Organizational  Construct 

2.2  Common  T&E  Date  Base  Requirements 
2.3  Deficiency  Reporting 

2.4  Temp  Updates 

2.5  Integrated  Test  Program  Schedule 
3.1  T&E  Strategy 

3.2  Evaluation  Frame  Work 

3.3  Developmental  Evaluation  Approach 
3.3.1  Miss  ion- Oriented  Approach 
3.3.2  Developmental  Test  Objectives 
3.3.3  Modeling  and  Simulation 
3.3.4  Test  Limitations 
3.41  Live  Fire  Evaluation  Approach 

3.4.1  Live  Fire  Test  Objectives 

3.4.2  Modeling  and  Simulation 

3.4.3  Test  Limitations 
3.5  Certification  for  IOT&E 

3.5.1  Assessment  of  Operational  Test  Readiness 

3.6  Operational  Evaluation  Approach 
3.6.1  Operation  Test  Objectives 

3.6.2  Modeling  and  Simulation 

3.6.3  Test  Limitations 


SEP 


1.0  Introduction 

1.1  Program  Description  and  Applicable  Documents 

1.2  Current  Program  Status 

1.3  Approach  for  SEP  Updates 
2.0  Program  Requirements 

.1  Capabilities  and  Key  Performance  Parameters 

2.2  Statutory  and  Regulatory  Requirements 

2.3  Specified  and  Derived  Requirements 
-•  2.4  Certification  Requirements 

2.5  Design  Considerations 
3.0  Technical  Staffing  and  Organizational  Planning 
3.1  Lead/Chief  Systems  Engineer  and  Functional  Leads 


2  IPT  Organization/Structure 
3.3  IPT  Staffing/Functional  Skills 
'3.4  IPT  Coordination 

3.5  Integration  with  Contractors  and  External  Organizations 
4.0  Technical  Baseline  Management 

4.1  Technical  Baseline  Management  Responsibility 

4.2  Defining,  Approving  and  Maintaining  the  Technical  Baseline 

4.3  Requirements  Traceability  and  Verification  and  Validation 

4.4  Specification  Tree  and  WBS  Link 

4.5  Technical  Maturity 

5.0  Technical  Review  Planning 

5.1  Event-Driven  Technical  Reviews 
5 2  Technical  Review  Management 

5.3  Chairing  of  Technical  Reviews 

5.4  Stakeholder  Participation  in  Technical  Reviews 

5.5  Peer  Participation  at  Technical  Reviews 

6.0  Integration  with  Overall  Management  of  the  Program 

6.1  Linkage  to  Other  Program  Management  Plans 

6.2  Program  Manager's  Approach  to  Using  Technical  Reviews 
6.3  Risk  Management  Integration 

6.4  Test  and  Evaluation 


*- 

■4— 

♦- 


Project  Information 
Level  One 

Level  One  &  Project  Information 

Governing 

Level  Two 
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Modular  Documents  Research  Results 


•  Evidence  showed: 

—  Various  subject  matter  experts  are  needed  within  a  project 
and  the  SME  can  vary  between  milestones  (chief  engineer, 
lead  system  engineer,  project  manager,  test  lead, 
logisticians,  etc.) 

—  Topic  area  information  is  co-located  in  multiple  documents 
and  various  SMEs  govern  the  information 

•  Migrating  to  a  role  based  modular  database  would 
increase  synchronization  and  consistency  across 
multiple  documents  and  could  increase  efficiency  for 
the  SME  and  overall  program 


O'Brien  /  Sept,  14,  2010 


UAHuntsville 

Rotorcraft  System  Engineering  and  Simulation  Center 


36 


UAHuntsville 

THE  UNIVERSITY  OF  ALABAMA  IN  HUNTSVILLE 


Modular  Documents  Concept 


•  Document  template  is  pulled  from  the  library  for  the  project 

•  Principal  writers  or  SMEs  are  selected  for  the  predetermined 
topic  areas 

•  Governing  information  is  written  by  the  subject  matter 
experts  and  made  available  to  the  pertinent  documents  (This 
information  could  be  pulled  from  already  written  documents 
within  the  tool,  require  newly  developed  information  or  a 
combination  of  the  two.) 

•  Remaining  topic  areas  that  are  specific  to  that  particular 
document  are  written 

•  Documents  are  frozen  and  version  controlled  at  each 
milestone 
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Role  Based  Documentation 
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Modular  Documents  Concept 
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SME  Information  Requests 


Home  Messages  Options  View  ▼  C 


J 

J 

J 


I CD  Documents 
a  to  Demo  Project 

]  Project  Configuration 
>EP 
TEMP 

ISP 

Project  Info 
|  Attachments 
-  B  Demo  Project  2 

|  Project  Configuration 

SEP 
TEMP 

ISP 

Project  Info 
^  Attachments 


Home  Messages  Options  View  ▼  Change  Password  Logout 

b  i  u  unk  m  IE  E  O  O  I  I  I  x2  x2ab€^;  ffl  P  <□  ft  [T  >1  DtfO  ^  “  111 

a.  Mission  Need 

Due  to  a  lack  of  situational  support  in  the  theater  of  operations  it  is  apparent  that  a  new  capability  to  provide  both  support  and  diagnosti 

b.  Mission  Need  -  Supported  Capability 

The  supported  capability  will  provide  awareness,  diagnostics  and  prevention  of  existing  problems  while  building  on  existing  capabilities 

c.  OV-1  Showing  the  operational  environment 
[Diagram  Here] 

d.  Organizations  which  the  system  will  be  integrated  (if  applicable) 

For  this  effort  we  will  coordinate  with  the  applicable  organizations  in  order  to  leverage  resources  and  ensure  stakeholder  interests  are  r 

e.  Organizations  which  the  system  will  be  integrated  -  Role  Definitions 

The  developers  will  develop  a  solution  and  will  coordinate  with  manufacturers  and  operations  personnel  to  ensure  proper  integration  of 

f.  Business  Case 

Due  to  the  current  costs  associated  with  the  existing  lack  of  situational  support,  and  the  current  support  for  this  solution  by  our  partner  01 
sufficient  need  and  funding  to  proceed  with  this  project. 

g.  System  Description  and  Configuration 

The  system  will  be  composed  of  modular  components  which  will  integrate  to  meet  mission  requirements.  These  components  will  be  co 
configuration  system  which  both  provides  ease  of  configuration  as  well  as  ensures  optimal  configuration. 

h.  System  Description  and  Configuration  -  Key  features 

The  systems  key  features  will  include  it's  ease  of  use  and  ability  to  support  optimal  configurations. 

i.  Threat  Environment 

The  threat  environment  will  be  complex  and  will  be  determined  primarily  by  the  theater  of  operations. 

j.  Analysis  of  Alternatives 
Contact  the  A  team. 

k.  Acquisition  Strategy  Overview 
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Demonstration  Overview 

•  Demonstrate  SET  Version  1.0 

•  Demonstration  of  the  new  user  interface  and  direct 
mappings  of  topic  areas  in  Version  1.5 

•  Final  product  will  have  all  the  capabilities  of  SET 
Version  1.0 

•  Level  1  and  Level  2  mappings  need  further 
finalization 

•  Today's  demonstration  will  show  SET  1.0  and 
illustrate  topic  area  mapping  capabilities 
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SET  Version  1.5 

_ Systems-Engineering-Elan _ 

Home  Messages  Options  View  ▼  Change  Password  Logout 

b  /  »  U!*  n  OI  :E  e  S  S  f  i  I  ^  fflCiSljDlft’iOlfO'&SSlII 

1  Introduction 

1.1  Program  Description  and  Applicable  Documents 

a.  OV-1  Showing  the  operational  environment 

[Diagram  Here]  |  Linkages  | 

b.  Business  Case 

Due  to  the  current  costs  associated  with  the  existing  lack  of  situational  support,  and  the  current  support  for  this  solution  by  our  partner  organizations  there  is  [  Linkages  | 
sufficient  need  and  funding  to  proceed  with  this  project. 

c.  System  Description  and  Configuration 

The  system  will  be  composed  of  modular  components  which  will  integrate  to  meet  mission  requirements.  These  components  will  be  configured  using  a  [  Linkages  | 

configuration  system  which  both  provides  ease  of  configuration  as  well  as  ensures  optimal  configuration 

d.  System  Description  and  Configuration  -  Key  features 

The  systems  key  features  will  include  it's  ease  of  use  and  ability  to  support  optimal  configurations.  |  Linkages  ] 

e.  Threat  Environment 

The  threat  environment  will  be  complex  and  will  be  determined  primarily  by  the  theater  of  operations.  [  Linkages  | 

f.  Evaluation  Framework 

[  Linkages  ] 

1.2  Current  Program  Status 

a.  Acquisition  Strategy  Overview 

[  Linkages  | 

b.  Previous  Testing 
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Home  Messages  Options  View^  Change  Password  Logout 

b  /  a  us  rm  ;e  ie  o  e  i  n  ^  **  ««  i  V  El  e  G  fin  nb_E  otfO  ^  8 

1  Introduction 

1.1  Program  Description  and  Applicable  Documents 

[Diagram  Here] 

Due  to  the  current  costs  associated  with  the  existing  lack  of  situational  support,  and  the  current  support  for  this  solution  by  our  partner  organizations  there  is  sufficient 
need  and  funding  to  proceed  with  this  project. 

The  system  will  be  composed  of  modular  components  which  will  integrate  to  meet  mission  requirements.  These  components  will  be  configured  using  a  configuration 
system  which  both  provides  ease  of  configuration  as  well  as  ensures  optimal  configuration. 

The  systems  key  features  will  include  it's  ease  of  use  and  ability  to  support  optimal  configurations. 

The  threat  environment  will  be  complex  and  will  be  determined  primarily  by  the  theater  of  operations. 

1.2  Current  Program  Status 


1.3  Approach  for  SEP  Updates 

2  Program  Requirements 

Due  to  a  lack  of  situational  support  in  the  theater  of  operations  it  is  apparent  that  a  new  capability  to  provide  both  support  and  diagnostics  will  be  required. 

2.1  Capabilities,  Requirements  and  Concept(s)  of  Operation 
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Next  Steps  for  Modular  Documents 

•  Higher  fidelity  of  the  topic  areas  and 
information  requests 

•  Level  1  and  Level  2  mappings  further 
definition  and  finalization 

•  Determination  of  documentation  process 

•  Determination  of  roles 

•  Final  determination  of  governing  entities 


RSESC  will  continue  to  leverage  research  being  performed  for  the  Department 
of  Defense,  NAVAIR  and  NASA  Marshall  Space  Flight  Center  to  implement 
effective  systems  engineering  tailored  to  the  customers’  needs 
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Areas  for  Further  Benefits 


•  Addition  of  more  documents,  possibilities  include 
acquisition  strategy,  ICD,  CDD,  CPD  and  many  others 
that  are  referenced  in  these  documents  to  increase 
benefits 

•  Increased  tailoring  for  small  programs  and  block 
modifications 

•  Inclusion  of  Statutory,  Regulatory  and  Certification 
Requirements  and  other  standard  items 
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Summary 


•  From  the  research  performed  using  a  data-centric  modular 
database  for  creating  program  documentation  is  feasible  and 
could  be  beneficial 

•  Evidence  shows  dependencies  and  correlations  between  the 
three  artifacts 

•  Automated  mapping  function,  database  capabilities,  statistical 
and  data  collection  methods  designed  within  the  SET  tool 
allowed  research  to  be  performed  on  the  most  advantageous 
method  while  providing  both  a  testbed  environment  and 
implementation  tool  for  users 

•  SET  Version  1.0  is  available  for  use  to  any  DoD  organization 

•  User  inputs  are  encouraged 
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Questions? 
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Sue  O'Brien  Stas'  Tarchalski 

Univ  of  Alabama  in  Huntsville  Stevens  Institute  of  Technology 

Acting  Director  RSESC  410-571-1173 

256-824-6133  Stas.Tarchalski@stevens.edu 

obriens@uah.edu 

http://set.uah.edu/ 


Welcome  to  the  System  Engineering  Toolkit(SET) 

Please  Log  In 

Username _ 

Password  ' 

1  Login  1 


New  User? 


Help 


FAQs 


Register  for  SET  Support 

Eligibility:  DoD,  All  Service  Branches,  Government  Ouickstart  Guide 

Contractors 


How  do  I  register  for  SET? 

How  do  I  gain  access  to  an  existing  document? 

How  do  I  reset  mv  password? 

What  is  SET? 


SET  is  Patent  Pending  UAHuntsville  and  was  developed  in  partnership  with  PEO  Aviation  and  AMRDEC 

UAHuntsville  -•**  . 

-V . . . .  •  Vr-.-T- 

KKDIHMT 
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BACK-UP 
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SEP  Topic  Area  Orphans 


Milestone 

Section 

Title 

A 

1.3 

Approach  for  SEP  Updates 

2.5 

Technology  Development  and  Evolving 
Acquisition  Strategy 

4.1 

Technology  Maturation  Responsibility 

5.1 

Event -Driven  Technical  Reviews 

5.2 

Technical  Review  Management 

5.3 

Chairing  of  Technical  Reviews 

5.4 

Stakeholder  Participation  in  Technical  Reviews 

5.5 

Peer  Participation  at  Technical  Reviews 

6.2 

Use  of  Critical  Paths  and  Technical  Reviews 

6.6 

Contracting  Considerations 

B 

1.3 

Approach  for  SEP  Updates 

2.2 

Statutory  and  Regulatory  Requirements 

4.1 

Technical  Baseline  Management  Responsibility 

4.4 

Specification  Tree  and  WBS  Link 

5.1 

Event  -Driven  Technical  Reviews 

5.2 

Technical  Review  Management 

5.3 

Chairing  of  Technical  Reviews 

5.4 

Stakeholder  Participation  in  Technical  Reviews 

5.5 

Peer  participation  at  Technical  Reviews 

6.2 

Program  Manager's  Approach  to  UsingTechnical 
Reviews 

6.6 

Contracting  Considerations 

C 

1.3 

Approach  for  SEP  Updates 

2.2 

Comparison  of  Data  to  Planning  Assumptions 

2.4 

Production  and  Design  Driven  Operations  & 
Support  Costs 

3.1 

Lead/Chief  Systems  Engineer  and  Functional 
Leads 

4.1 

Technical  Baseline  Management  Responsibility 

4.4 

Technical  Baseline 

Common  Themes 

i 

Milestone  and  Section 

SEP  Updates 

1.3  of  A,  B,  and  C 

Roles  and 
Responsibilities 

4.1A  and  B  and  C 

Reviews 

5.1-5.5A  and  B  and  C 

Contracting 

6.2  B  and  C 

6. 6 A  and  B  and  C 
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TEMP  Topic  Area  Orphans 


Section 

Title 

Description 

1.1 

Purpose 

2.4 

TEMP  Updates 

3.3.1 

Mission-Oriented  Approach 

Evaluate  mission  performance  in  a  mission  context  (focuses  on  how  the  system  will  be  employed) 

3.3.2 

Developmental  Test  Objectives 

Summarize  the  planned  objectives  and  stat  the  methodology  to  test  the  system  attributes  defined  by 
the  appicable  capability  requirement  document 

3.3.4 

Test  Limitations 

3.4 

Live  Fire  Test  and  Evaluation  Approach 

3.4.1 

Live  Fire  Test  Objectives 

3.4.2 

Modelings  Simulation 

in  terms  of  life  fire 

3.4.3 

Test  Limitations 

3.6 

Operational  Evaluation  Approach 

Independent  evaluation  of  the  system 

3.6.3 

Test  Limitations 

3.7 

Other  Certifications 

3.8 

Reliability  growth 

4.1.1 

Test  Articles 

Actual  number  and  timing 

4.1.2 

Test  Sites  and  Instrumentation 

4.1.3 

Test  Support  Equipment 

4.1.4 

Threat  Representation 

4.1.5 

Test  Targets  and  Expendables 

4.1.6 

Operational  Force  Test  Support 

4.1.7 

Models,  Simulations,  and  Testbeds 

4.1.8 

Joint  Mission  Environment 

Live,  virtual,  or  constructive  components  for  an  acceptable  environment 

4.2 

Federal,  State,  and  Local  Requirements 

environmental  regs 
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ISP  Topic  Area  Orphans 


Chapter  1:  Introduction 

Project  Info 

2.3  Step  3:  Determine  the  operational  users  and 
notional  suppliers  of  the  information  needed. 

2.9  Step  9:  Discuss  RF  Spectrum  needs. 

2.10  Step  10:  Perform  a  Net-Centric  Assessment 

2.12  Step  12:  Discuss  the  program's  Information 
Assurance  strategy  and  reference  the  Program 
Protection  Plan. 

IAS 

2.13  Step  13:  Identify  information  support  needs 
to  support  development,  testing  and  training. 

Chapter  3  -  Issues 

Appendix  D.  -  Acronym  List 

ISP 
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ISP  Example  Topic  Area  Orphans 


(U)  EXECUTIVE  SUMMARY 

1 

(U)  INTRODUCTION 

1.1.2 

(U)  Relationship  to  Other  Programs 

1.1.3 

(U)  Relationship  to  Relevant  Joint 

Functional  Concepts  (JFCs),  Joint 

1. 1.3.1 

(U)  Joint  Functional  Concepts 

1.1. 3. 2 

(U)  Associated  Integrated  Architectures 

1. 1.3.3 

(U)JCIDS 

1.2 

(U)  PROGRAM  DATA 

Current  MS  and  Acquistion  Status 
Integrated  Master  Schedule 
Increment  1  schedule 

Increment  II  schedule 

1.2.1 

(U)  Milestone  and  Acquisition  Status 

1.2.2 

(U)  Spiral  Evolution  Strategy 

1.2.3 

(U)  Program  Points  of  Contact 

1.3.1 

(U)  Information  Integrity 

1.3.2 

(U)  DoD  PKI  System  Architecture 

1.3.2. 1 

(U)  DoD  PKI  Certificate  Management 
Components 

1.3.3 

(U)  Role  Definitions 

1.3.4 

(U)  PKI  System  Interface  Overview 

1.4 

(U)  ISP  DOCUMENT  STRUCTURE 

2 

(U)  ANALYSIS 

2.3 

(U)  STEP  3  -  DETERMINE  OPERATIONAL 

USERS  AND  NOTIONAL  SUPPLIERS 

OV-4  Organizational  Relationship 
Role  Overview 

2.3.1 

(U)  Operational  Nodes  and  Elements  (OV-2) 

Operational  Nodes  and  Elements 
(OV-2) 

2.3.2 

(U)  Operational  Node  Activities 

Operational  Node  Activities  (SV-5) 

UAHuntsville 
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ISP  Example  Topic  Area  Orphans 

Continued 


2.12.1 

(U)  Program  Category  and  Life-Cycle  Status 

2.12.2 

(U)  Mission  Assurance  Category  and  Confidentiality 
Level 

2.12.3 

(U)  System  Description 

2.12.4 

(U)  Threat/Risk  Assessment 

2.12.5 

(U)  IA  Requirements 

2.12.6 

(U)  Certification  and  Accreditation 

2.12.7 

(U)IA  Testing 

2.12.8 

(U)  IA  Analysis 

2.13 

(U)  STEP  13:  IDENTIFY  SUPPORT  NEEDS  FOR 
DEVELOPMENT,  TESTING,  AND  TRAINING 

2.13.1 

(U)  Development 

2.13.2 

(U)  Testing 

2.13.3 

(U)  Developmental  Test  and  Evaluation  (DT&E) 

2.13.4 

(U)  Operational  Test  and  Evaluation  (OT&E) 

2.13.5 

(U)  Training 

2.13.6 

(U)  CC/S/A  Training  Requirements 

2.13.7 

(U)  LRA/TRA  Background,  qualifications,  experience, 
and  clearance  requirements 

3 

(U)  ISSUES 

Appendix  A 

References 

Appendix  D 

Acronym  List  and  Glossary  (AV-2) 

Appendix  E 

Public  Key  Infrastructure  Overview  and  Summary 
Information  (AV-1) 

Appendix  F 

Key  Interface  Profile  (KIP) 

Appendix  G 

Data  AND  Service  Exposure 

2.9 

(U)  STEP  9  -  DISCUSS  RADIO  FREQUENCY  SPECTRUM 

NEEDS 

2.1 

(U)  STEP  10  -  PERFORM  A  NET-CENTRIC  ASSESSMENT 

2.10.1 

(U)  Step  10-A:  Evaluate  Program  Against 

Measurement  Criteria 

2.10.1.1 

(U)  PKI's  Incorporation  of  NCOW  RM  Capabilities  and 
Services 

2.10.1.2 

(U)  Technical  View  Products 

2.10.1.3 

(U)  SV-TV  Bridge 

2.10.1.4 

(U)  Definitions  and  Vocabulary 

2.10.1.5 

(U)  GIG  Mission  Area  Initial  Capabilities  Document 
(MA  ICD) 

2.10.2 

(U)  Step  10-B:  Compliance  with  Emerging  NCES  CESs 

2.10.3 

(U)  Step  10-C:  Assess  the  Use  of  Software -Compliant 
Radios 

2.10.4 

(U)  Step  10-D:  Assess  the  Use  of  IPv6  DoD  Net- 
Centric  Data  Strategy 

2.10.5 

(U)  Step  lOe:  Assess  the  Use  of  DoD-Centric  Data 
Management  Strategy 

2.10.6 

(U)  Step  10-F:  Assess  the  GIG  Bandwidth  Expansion 
Relationship 

2.10.7 

(U)  Step  10-G  Net-Ready  Key  Performance 

Parameter  (NR-KPP)  Statement 

2.10.8 

(U)  Applicability  of  Major  Net -Centri city 
Characteristics  of  PKI  Increments  One  and  Two 

2.12 

(U)  STEP  12:  DISCUSS  THE  INFORMATION  ASSURANCE 

STRATEGY 
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Overview  of  the  Department  of  Defense 
Systems  Engineering  Initiatives 

•  In  February  2004,  the  Department  of  Defense  mandated  the  re¬ 
vitalization  of  systems  engineering  throughout  all  the  services 

•  All  acquisition  category  (ACAT)  level  programs  were  required  to 
create  system  engineering  plans  (SEP) 

•  From  this  mandate  the  Office  of  the  Deputy  Under  the  Secretary  of 
Defense  (OSD)  created  a  SEP  Preparation  Guide  for  all  programs  to 
follow 

•  RSESC  responded  to  the  PEO-Aviation's  need  to  enhance  systems 
engineering  planning  by  creating  a  checklist  from  the  SEP 
Preparation  Guide  to  ensure  requirements  for  systems  planning 
were  met  in  the  SEP 

•  This  checklist  evolved  into  the  Systems  Engineering  Toolkit  (SET),  an 
online  application  designed  to  ease  the  burden  of  creating  a  SEP, 
provide  a  basis  for  metrics,  share  information,  and  enhance 
Systems  Engineering  planning 
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•  December  2004,  First  OSD  Systems  Engineering 
Plan  Preparation  Guide  released 

•  The  guide  did  not  dictate  the  SE  processes  to  be 
used  by  a  program,  it  only  addressed  the  key  focus 
areas  to  be  considered. 

•  Shortly  following  Version  0.95,  released  with  "SEP 
Focus  Areas  for  Technical  Planning,  version  0.95." 

•  August  2005,  version  1.0 

•  February  2006,  version  1.2 

•  October  2007,  version  2.0 

•  April  2008,  version  2.01 

•  Changes  to  acquisition  are  resulting  from  the 
Weapon  Systems  Acquisition  Reform  Act  of  2009, 

•  July  2009,  Addendum  to  SEP  Preparation  Guide 
version  2.01," 


Systems  Engineering  Plan 
Preparation  Guide 


“ Technical  Planning  for  Mission  Success ” 


Version  2.01 
April  2008 

Department  of  Defense 

Office  of  the  Deputy  Under  Secretary  of  Defense  for 
Acquisition  and  Technology 

Systems  and  Software  Engineering 
Enterprise  Development 


Seven  updates  in  five  years 
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RSESC  Overview 


The  University  of  Alabama  in  Huntsville  (UAH)  Rotorcraft  Systems  Engineering  and 
Simulation  Center  (RSESC)  is  a  state-of-the-art  research  and  development  Center  that 
provides  engineering  solutions  and  products  to  Department  of  Defense  (DoD), 

National  Aeronautics  and  Space  Administration  (NASA),  and  industry  customers  with  a 
focus  on  aerospace  flight  hardware  systems.  RSESC  brings  flight  proven,  unparalleled 
capabilities  in  atmospheric  and  aerospace  flight  hardware  development,  rotorcraft, 
fabrication,  integration,  and  testing.  RSESC  has  proven  expertise  in  the  fields  of 
engineering  design  and  analysis,  rapid  prototyping,  fabrication,  integration,  destructive 
and  non-destructive  testing,  flight  qualification  and  acceptance  testing,  and  launch/ 
mission  services. 


The  Center's  foundation  has  been  in  the  development  of  manned  and  unmanned 
aerospace  systems.  RSESC  brings  three  key  ingredients  that  are  absolutely  necessary 
to  assure  mission  success:  (1)  knowledge  of,  and  experience  with,  launch  vehicle 
systems  and  payload  development,  (2)  experience  and  in  depth  knowledge  of  the 
design  requirements  and  the  mission  objectives,  and  (3)  experience  in  the  detailed 
engineering  design,  analysis,  fabrication,  and  integration  of  flight  hardware  systems. 


http://rsesc.uah.edu/ 
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Notes 
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